Validación en español de un cuestionario para la evaluación de la calidad de la mentoría en investigación en ciencias de la salud / Spanish validation of a questionnaire for the quality evaluation of research mentoring in health sciences

Introducción. Es relevante contar con un cuestionario breve y auto-administrado para evaluar la calidad de los procesos de mentoría en investigación en la comunidad científica hispanohablante. Objetivos. Validar una versión abreviada, auto-administrada y en español del cuestionario multidimensional Evaluación de las competencias de mentoría. Métodos.1) Traducción y adaptación transcultural; 2) Reducción de la versión traducida; 3) Validación de la versión abreviada en una muestra local de 159 participantes respecto de su validez de constructo (análisis factorial confirmatorio) y de criterio (correlación de su puntaje total con el de una pregunta agregada y con la versión extensa del cuestionario). Resultados. Obtuvimos un cuestionario abreviado, en español y auto-aministrado de 17 ítems divididos en cinco dimensiones: 1) Mantenimiento de una comunicación efectiva, 2) Alineación de expectativas, 3) Evaluación del conocimiento,4) Promoción de la independencia, 5) Promoción del desarrollo profesional. El modelo hipotetizado ajustó de manera aceptable a los datos de nuestra muestra de validación (RMSEA=0,045; CFI=0,992; TLI=0,99 y WRMR=0,564). Todos los parámetros estimados para los ítems individuales tuvieron significancia estadística, oscilando las cargas factoriales estandarizadas entre 0,571 y 0,936. La fiabilidad compuesta de los diferentes dominios estuvo comprendida entre 0,764 y0,865, y la varianza media extractada, entre 0,522 y 0,644, en concordancia con lo recomendado. La validez convergente fue adecuada ya que las cargas factoriales estandarizadas de 94 % de los ítems del modelo final fueron mayores a 0,6 y con significancia estadística (valor t>1,96). La correlación entre los cinco factores fue alta (0,740 a 0,944). En la mayoría de las comparaciones, el cuadrado de dichas correlaciones fue superior a la varianza media extractada, lo que refleja una validez divergente o discriminante baja. El puntaje de la versión abreviada tuvo una correlación positiva y alta (Coeficiente de Pearson 0,847; p<0,001) con la pregunta agregada como criterio externo concurrente de validación y muy alta correlación (coeficiente de Pearson: 0,988;p<0,001) con el puntaje de la versión original traducida de 26 ítems. Conclusiones. La versión abreviada en español del cuestionario Evaluación de las competencias de mentoría tiene adecuadas propiedades psicométricas y puede ser aplicada en forma auto-administrada, lo que la vuelve la primera herramienta en español para evaluar procesos de mentoría en investigación. (AU)

Introduction. It is relevant to have a short and self-administered questionnaire to assess research mentoring processquality in the Spanish-speaking scientific community. Objectives. To validate a short and self-administered version in Spanish of the multidimensional questionnaire Mentoring Competency Assessment. Methods.1) Translation and cross-cultural adaptation; 2) Reduction of the translated version; 3) Validation of the shortenedversion in a local sample of 159 participants regarding its construct validity (confirmatory factor analysis) and its criterion validity (correlation of its total score with that of an additional question and with the long version of the questionnaire). Results. We obtained an abbreviated (17 items) and self-administered questionnaire in Spanish, divided into five constructs: 1) Maintaining effective communication, 2) Aligning expectations, 3) Addressing knowledge, 4) Promoting independence, 5) Promoting professional development. The hypothesized model fit acceptably to the data from our validation sample (RMSEA=0.045; CFI=0.992; TLI=0.99 and WRMR=0.564).All the parameters estimated for the individual items were statistically significant, with their standardized factor loads ranging from 0.571 to 0.936. The composite reliability of the different domains ranged between 0.764 and 0.865, and the mean extracted variance, between 0.522 and 0.644, in accordance with the recommended range. Convergent validity was adequate since the standardized factor loads of 94 % of the items in the final model were greater than 0.6 and with statistical significance (t-value >1,96). The correlation between the five factors was high (0.740 to 0.944) and in most of the comparisons, the square of these correlations was higher than the average variance extracted, reflecting low divergent or discriminant validity. The score of the shortened version had a positive and high correlation (Pearson coefficient 0.847;p <0.001) with the additional question as a concurrent external validation criterion and a very high correlation (Pearson coefficient: 0.988; p <0.001) with the score of the original 26-item translated version. Conclusions. The shortened Spanish version of the Mentoring Competency Assessment questionnaire has adequate psychometric properties and can be applied in a self-administered way, which makes it the first tool in Spanish to assessresearch mentoring processes. (AU)

Scientific production indicators and researchers training in the Brazilian Collective Health / Indicadores de la producción científica y la formación de investigadores en la Salud Colectiva Brasileña / Indicadores de produção científica e formação de pesquisadores na Saúde Coletiva brasileira

ABSTRACT Objective: To evaluate the scientific production, generation of patents and researchers training among Brazilian Collective Health professors who were awarded a Pq/CNPq productivity scholarship from 2000 to 2012 and to verify the existence of an association between these production modalities and the characteristics of the professors, such as gender, training and origin. Method: An analytical cross-sectional study was carried out from 2000 to 2012, and the Prevalence Ratio was calculated using Poisson regression. For the statistical analyzes, the SPSS® program was used. Results: Of particular note are regional and institutional concentration, consistent scientific output, important researchers training, and a primordial but still timid generation of patents. We found an association between the "scientific production", "researchers training" outcomes, and the gender characteristics, such as the formation and origin of the Pq professor. Conclusion: These findings can guide the decision-making aimed at the deconcentration of scientific production and researchers training in the Brazilian Collective Health.

RESUMEN El objetivo del trabajo fue evaluar la producción científica, la generación de patentes y la formación de investigadores entre docentes de la Salud Colectiva brasileña que fueron contemplados con becas de productividad Pq/CNPq en el período de verano y verificar la existencia de la asociación entre estas modalidades de producción; y las características de los docentes, como el género, la formación y el origen. Método: Se realizó un estudio transversal analítico en el período de referencia y se calculó la razón de prevalencia por medio de la regresión de Poisson. Para los análisis estadísticos se utilizó el programa SPSS®. Resultados: Se destacan la concentración regional e institucional, la consistente producción científica, la importante formación de investigadores; y la significativa, pero aún tímida, generación de patentes. Se encontró una asociación entre los resultados de la producción científica, la formación de investigadores y las características género, formación y origen del docente Pq. Conclusión: Esos hallazgos pueden orientar la toma de decisiones dirigidas a la desconcentración de la producción científica y la formación de investigadores en Salud Colectiva en Brasil.

RESUMO Objetivo: Avaliar a produção científica, geração de patentes e formação de pesquisadores entre docentes da Saúde Coletiva brasileira que foram contemplados com bolsas de produtividade Pq/CNPq no período 2000-2012 e verificar a existência de associação entre estas modalidades de produção e características dos docentes, como gênero, formação e origem. Método: Foi realizado um estudo transversal analítico no período 2000-2012 e foi calculada a razão de prevalência por meio da regressão de Poisson. Para as análises estatísticas, utilizou-se o programa SPSS®. Resultados: Destacam-se a concentração regional e institucional, consistente produção científica, importante formação de pesquisadores e primordial, mas ainda tímida geração de patentes. Foi encontrada associação entre os desfechos "produção científica", "formação de pesquisadores", e as características de gênero, como formação e origem do docente Pq. Conclusão: Estes achados podem orientar a tomada de decisões voltadas para a desconcentração da produção científica e formação de pesquisadores em Saúde Coletiva no Brasil.

Quality and completeness of data documentation in an investigator-initiated trial versus an industry-sponsored trial.

Literature on the quality and completeness of data and documentation in investigator-initiated research studies is scarce. We carried out a study to compare the quality of data and documentation in an investigator-initiated trial (IIT) with those in an industry-sponsored study. We retrospectively studied the archived data pertaining to 42 patients enrolled in two trials, 14 patients in an industry-sponsored study and 28 randomly selected patients from an IIT. Trial-related documents were examined and scored for the completeness of the acquisition of data and for storage as per a pre-formulated checklist. Weighted scores were given for each point on the checklist proportional to its relative importance in the data documentation process. A global score and sub-scores for specific modules were given for each subject. The scores in the two studies were compared using the Mann Whitney U test. The total score for general documents was similar in the IIT (14/14, 100%) and the sponsored study (24/25, 96%). The mean summary global score obtained for study-specific documents (maximum possible score, 32) in the IIT (27.1; 95% CI 26.4-27.8) was also not significantly different from that in the sponsored study (27.9; 95% CI 26.7-29.1; p=0.1291). Thus, investigatorinitiated studies carried out by independent researchers in highvolume academic centres, even without active data monitoring and formal audits, appear to adhere to the high standards laid out in the International Conference on Harmonisation-Good Clinical Practices guidelines, ensuring accuracy and completeness in data documentation and archival.

Job Analysis of Clinical Research Coordinators Using the DACUM Process

PURPOSE: This study was done to analyze the job of clinical research coordinators (CRCs). METHODS: Through the "developing a curriculum (DACUM)" workshop, the definition of CRCs' role was described and CRCs' duties and tasks were identified. Finally, the developed duties and tasks were validated for importance, difficulty, and frequency. RESULTS: A CRC is defined as the one who coordinates and performs tasks related to clinical research/trials among investigators, participants, and sponsors according to the Good Clinical Practice at institutions conducting clinical trials. Twelve duties and 78 tasks were identified on the DACUM chart which represented the importance, difficulty, and frequency of tasks represented as A, B, and C respectively. Based on determinant coefficient (DC) of the task, the highest ranked task was confirming the eligibility of participants for research (DC=8.03) and the lowest was inventory management for clinical study materials (3.95). CONCLUSION: In this study, the job of a CRC was analyzed through the DACUM process and it was found that CRCs were doing various duties and tasks. Based on these results, it is suggested that it is necessary to develop CRC education programs considering the career ladder of CRCs.

Local technicians in long-term research projects: evaluation of 25 years experience in an active tropical research station

Most field ecology is conceived and financed by scientists from urban areas but is actually carried out in rural areas. Field staff can either be imported from urban areas or recruited from local residents. We evaluated the advantages and disadvantages of involving rural residents as local technicians over a 25- year period at active field research site in Costa Rica. We defined "local technicians" as local residents with no university education who acquired significant experience in field data collection, data management and/or laboratory work. We analyzed the experiences of incorporating these technicians into field research In developing countries from the points of view of scientist and of the local technicians themselves. Primary data were written responses from to a standardized survey of 19 senior scientists and Ph.D. students, and results from standardized personal interviews with 22 local technicians. Researchers highlighted the advantages of highly-skilled technicians with minimal staff turnover, as well as the technicians’ knowledge of local ecological conditions. Local technicians considered the primary advantages of their jobs to be opportunities for continuing education training in science as well as cultural enrichment through interactions with people of different cultures. The main challenges identified by researchers were the lack of long-term funding for projects and extended training required for local technicians. Local technicians can be of great benefit to research projects by providing high-quality data collection at reasonable costs with low staff turnover. Over the last 25 years the research model at the field station we studied has evolved to the point that most long-term projects now depend heavily on local technicians. This model of involving local technicians in long-term research has multiple benefits for the researchers, the technicians and the local community, and could be adapted to a variety of settings in rural areas of developing countries. Rev. Biol. Trop. 59 (4): 1455-1462. Epub 2011 December 01.

El factor de impacto, sus variantes y su influencia en la promoción académica / Impact factor, its variants and its influence in academic promotion

La bibliometría refiere a un conjunto de métodos de análisis o medición de la información. Aunque estos métodos pertenecen a la bibliotecología y ciencias de la información, algunas variables bibliométricas son muy frecuentemente utilizadas en áreas afines. Una de las más populares es el Factor de Impacto (FI). El FI es utilizado para determinar el impacto de un área en una determinada disciplina, el impacto de un grupo de investigadores o el de un trabajo en particular. Esta variable es usada en la evaluación cuantitativa de la producción académica y estaría amenazando el curso de la metodología tradicional y la evaluación de la investigación científica. En nuestro medio, los miembros de las comisiones evaluadoras de instituciones de investigación intensiva como el Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), utilizan el FI para calificar el trabajo de los investigadores. Este artículo revisa el crecimiento exponencial de la bibliometría e intenta exponer la insatisfacción general sobre la calidad analítica del FI. La insatisfacción mencionada es evidente al observar el número de investigaciones en curso que intentan obtener una nueva variable de calidad analítica perfeccionada.

Bibliometrics is a set of methods used to study or measure texts and information. While bibliometric methods are most often used in the field of library and information science, bibliometrics variables have wide applications in other areas. One popular bibliometric variable is Garfield´s Impact Factor (IF). IF is used to explore the impact of a given field, the impact of a set of researchers, or the impact of a particular paper. This variable is used to assess academic output and it is believed to affect adversely the traditional approach and assessment of scientific research. In our country, the members of the evaluation committees of intensive research institutions, e.g. the National Scientific and Technical Research Council (CONICET) use IF to assess the quality of research. This article revises the exponential growth of bibliometrics and attempts to expose the overall dissatisfaction with the analytical quality of IF. Such dissatisfaction is expressed in the number of investigations attempting to obtain a better variable of improved analytical quality.

Autoria de um trabalho científico / Authorship of a scientific work

[]

Fator de impacto: importância e influência no meio editorial, acadêmico e científico / Journal impact factor: this editorial, academic and scientific influence

Neste relato, os autores apresentam informações sobre os instrumentos bibliométricos e a sua importância na aferição da qualidade dos periódicos científicos, pesquisadores e docentes. Apresentam em particular a história e a implantação do fator de impacto do Institute for Scientific Information existente desde 1955. São apresentadas e discutidas as críticas referentes à inadequação do fator de impacto para avaliação da produção científica, uso indevido e estratégias editoriais de manipulação deste índice bibliométrico. É apresentada a nova classificação CAPES para os periódicos, baseada em vários critérios e no Fator de impacto, em especial, e a sua influência na vida acadêmica e científica nacional. Conclui que, apesar de todos os óbices e discussões, o Fator de Impacto do Institute for Scientific Information ainda é uma ferramenta útil e, isoladamente, a única existente para avaliar os periódicos científicos e a produtividade intelectual

In this report the authors present information on the bibliometric instruments and their importance in measuring the quality of scientific journals and researchers. They in particular the history and deployment of the impact factor of the existing Institute for Scientific Information since 1955. Are presented and discussed the criticism regarding the inadequacy of the impact factor for evaluation of scientific production, misuse and strategies editorial handling of the bibliometric index. It is presented to the new classification CAPES for the journals, based on various criteria and the impact factor and its influence on national scientific and academic life. The authors conclude that, despite all obstacles and discussions, the impact factor of the Institute for Scientific Information is still an useful tool and the only isolation available to assess the scientific and intellectual productivity